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Special Issue on Reinforcement Learning 
Guest Editor: Leslie Pack Kaelbling 


Thomas G. Dietterich 
Leslie Pack Kaelbling 
Efficient Reinforcement Learning through Symbiotic Evolution 
David E. Moriarty and Risto Mikkulainen 
Linear Least-Squares Algorithms for Temporal Difference Learning 
Steven J. Bradtke and Andrew G. Barto 
Feature-Based Methods for Large Scale Dynamic Programming 
John N. Tsitsiklis and Benjamin Van Roy 
On the Worst-Case Analysis of Temporal-Difference Learning Algorithms 
Robert E. Schapire and Manfred K. Warmuth 
Reinforcement Learning with Replacing Eligibility Traces : 
Satinder P. Singh and Richard S. Sutton 
Average Reward Reinforcement Learning: Foundations, Algorithms, and Empirical 
Sridhar Mahadevan 
The Loss from Imperfect Value Functions in Expectation-Based and Minimax-Based 
Matthias Heger 
The Effect of Representation and Knowledge on Goal-Directed Exploration with 
Reinforcement-Learning Algorithms Sven Koenig and Reid G. Simmons 
Creating Advice-Taking Reinforcement Learners 
Richard Maclin and Jude W. Shavlik 
Technical Note: Incremental Multi-Step Q-Learning 
Jing Peng and Ronald J. Williams 
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Representation of Finite State Automata in Recurrent Radial Basis Function Net- 
Paolo Frasconi, Marco Gori, Marco Maggini and Giovanni Soda 
Scaling Up Inductive Learning with Massive Parallelism 
Foster J. Provost and John M. Aronis 
Classification by Feature Partitioning H. Altay Giivenir and Izzet Sirin 
Learning in the Presence of Concept Drift and Hidden Contexts 
Gerhard Widmer and Miroslav Kubat 
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Book Review: Inductive Logic Programming: Techniques and Applications 
Michael Pazzani 

A Reply to Pazzani’s Book Review of Inductive Logic Programming: Techniques 

and Applications Nada Lavraé and Saso and Dzeroski 
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Special Issue on Robot Learning 
Guest Editors: Judy A. Franklin, Tom M. Mitchell and Sebastian Thrun 


Introduction Judy A. Franklin, Tom M. Mitchell and Sebastian Thrun 
Real-World Robotics: Learning to Plan for Robust Execution 
Scott W. Bennett and Gerald F. DeJong 

Robot Programming by Demonstration (RPD): Supporting the Induction by Human 
Interaction H. Friedrich, S. Miinch, R. Dillmann, S. Bocionek and M. Sassin 
Performance Improvement of Robot Continuous-Path Operation through Iterative 
Learning Using Neural Networks 

Peter C.Y. Chen, James K. Mills and Kenneth C. Smith 
Learning Controllers for Industrial Robots 
sah eliticceepaihiacheaesisichiaaiiee C. Baroglio, A. Giordana, M. Kaiser, M. Nuttin and R. Piola 
Active Learning for Vision-Based Robot Grasping 

Marcos Salganicoff, Lyle H. Ungar and Ruzena Bajcsy 
Purposive Behavior Acquisition for a Real Robot by Vision-Based Reinforcement 


Minoru Asada, Shoichi Noda, Sukoya Tawaratsumida and Koh Hosoda 
Learning Concepts from Sensor Data of a Mobile Robot 
Volker Klingspor, Katharina J. Morik and Anke D. Rieger 
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BEXA: A Covering Algorithm for Learning Propositional Concept Descriptions 
Hendrik Theron and Ian Cloete 

Technical Note: Some Properties of Splitting Criteria 

Stacked Regressions 

On Learning Visual Concepts and DNF Formulae 


Thomas G. Dietterich 
A Lattice Conceptual Clustering System and Its Application to Browsing Retrieval 
Claudio Carpineto and Giovanni Romano 
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Bagging Predictors 
Unifying Instance-Based and Rule-Based Induction 
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Error Reduction through Learning Multiple Descriptions 
Kamal M. Ali and Michael J. Pazzani 
A Decision-Tree Model of Balance Scale Development 
William C. Schmidt and Charles X. Ling 
Efficient Incremental Induction of Decision Trees 
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Exploration Bonuses and Dual Control. ... Peter Dayan and Terrence J. Sejnowski 
Using the Minimum Description Length Principle to Infer Reduced Ordered Deci- 
sion Graphs Arlindo L. Oliveira and Alberto Sangiovanni-Vincentelli 
PAO Learning of One-Dimensional Patterns 

Paul W. Goldberg, Sally A. Goldman and Stephen D. Scott 
On-line Prediction and Conversion Strategies 
Nicold Cesa-Bianchi, Yoav Freund, David P. Helmbold and Manfred K. Warmuth 
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Special Issue on COLT ’94 
Guest Editor: Thomas Hancock 


Guest Editor’s Introduction 
The Power of Amnesia: Learning Probabilistic Automata with Variable Memory 
Dana Ron, Yoram Singer and Naftali Tishby 
CLASSIC Learning Michael Frazier and Leonard Pitt 
Rigorous Learning Curve Bounds from Statistical Mechanics 
David Haussler, Michael Kearns, H. Sebastian Seung and Naftali Tishby 
On the Limits of Proper Learnability of Subclasses of DNF Formulas 
Krishnan Pillaipakkamnatt and Vijay Raghavan 
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